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Abstract 


The tremendous growth of information technology in the recent years has 
made it possible to design a variety of telemedicine systems. Several large scale 
multinational projects are currently being pursued which is revolutionizing remote 
health care. Teleradiology is one area where many projects are being undertaken. 
In India, there have been very few such efforts mainly because of lack of proper 
IT infrastructure and prohibitive costs of large scale telemedicine systems. 

In this work, we develop an inexpensive teleradiology kit which can run over 
any TCP network. It includes a client program providing a graphical user in- 
terface to the doctor who can retrieve data from a server site where MRI brain 
slices of patients are available. Other features implemented include remote au- 
thentication, automatic brain segmentation by the server, knowledge-based image 
compression prior to data transmission, support for multiple patients and data 
caching. 

Brain segmentation is a prerequisite of many important MRI post-processing 
algorithms. It also allows for data compression. The automatic brain segmen- 
tation algorithm implemented on the server site is based on existing automatic 
thresholding and morphological methods. The algorithm has been modified to 
improve computational efficiency. 
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Chapter 1 


Introduction 


1.1 Motivation for Remote Radiologist 

Information technology is a discipline that defies all bounds and barriers and has 
already demonstrated the most amazing developmental “curve” that no other 
discipline has ever witnessed or generated during what sounds like a mere “nano” 
time span. While the internet has captured much of the world’s attention and con- 
tinues to do so, the issues surrounding its functionalities, as well as its inevitability 
as an “everyday” tool in the future, are becoming more complex. Network traffic 
congestion, information security, address space and high bandwidth requirements 
are just a few examples. The continued search for newer solutions for addressing 
these issues has resulted in the evolution of Internet’s other “adjuncts”. In this 
framework, one talks about projects and protocols such as the Internet II, the 
very-high-speed backbone network services (vBNS), the next generation Internet 
Protocol IPv6 etc. 
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Two major disciplines that have been and will continue to benefit from such 
developments are medicine and health care. Numerous biomedical applications 
have already expounded on the role and impact of the “digital future" that 
medicine and health caxe hold [1]. With the emergence of a wide class of en- 
abling teciinologies such as fiber optic systems, integrated services digital net- 
works (ISDN), asynchronous transfer mode (ATM) etc., we have already seen 
the proliferation of these technologies in a number of health care and biomedi- 
cal engineering projects. Examples include telemedicine, teleradiologj', hospital- 
physician networks, health care delivery systems and application of virtual reality 
and telerobotic technologies. 

1.1.1 An International Perspective 

Computing and communications technologies have advanced to the point where 
the world is gradually moving toward collaborative medicine and collaborative re- 
search through distributed system capabilities over high-speed networks and new 
multimedia and video conferencing technologies. The various National Infor- 
mation Infrastructure and Global Information Infrastructure (NII/GII) concepts 
that are constantly evolving in several countries, along with major telemedicine 
projects jointly being pursued by several countries are just pointers to this fact. 

Examples of such multinational efforts are: 

• Several projects under the auspices of European Commission (EC) like the 
TeleSCAN program which demonstrates the benefits of multimedia telem- 
atics to the European oncologist. 

• SuperJANET: This is the high bandwidth Joint Academic Network in the 
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UK which is exploited in several major projects like neurosurgery planning, 
Interactive Teaching program in surgery etc. 

• Medical and health care services based on the World Wide Web (WWW). 
Examples include Visible Human Data (VHD) [2] which is a huge digital 
database of MRI and CT images and Visible Embiv'o Project [3] whose 
aim is to digitize sets of serial microscopic cross sections through human 
embryos. 

• The new generation teleradiology system called CHILI 4] being developed 
in Germany. At the core of the system is a general radiological workstation 
that possesses additional functions for teleradiology. 

• Telemedicine remote consultation and diagnosis (RCD) software developed 
in the University of Arizona [5]. RCD allows physicians to collaborate 
on radiology and pathology cases from distributed geographical locations. 
They have used object-oriented design methodology to design and develop 
a software system in modular fashion. 


1.1.2 The Indian Scenario 


In India, however, the effect of such a sweeping change in the field of health 
care is not as visible. The concept of Nil has been adopted by the National 
Informatics Center’s Network (NICNET) which presently connects 15 major cities 
and about 500 districts. But mainly because of the prohibitive costs of expensive 
technologies such as high-speed dedicated ISDN lines, there have been few or 
almost no major project initiatives. 

However, if we carefully look into the huge amount of information as well as 
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tools still available to us at a relatively lower cost through the internet, we can 
build inexpensive health care systems, which can actually improve the quality of 
health care as well as retluce the overall costs of the system. This is what has 
been the motivation behind this work. 

We have designed a simple client-server application where the client software 
is a graphical user interface (GUI) at the doctor’s site whereas the serv’er runs at 
a remote patient site where MRI scans of patients are taken. Not only can the 
doctor (the human radiologist) view the scans through the GUI, he has the option 
of applying several automated algorithms to it. Whereas these post-processing 
algorithms have not been implemented as part of the kit, automatic brain seg- 
mentation at the server site has been implemented using a fast algorithm adapted 
from [6]. 


1.2 Motivation for Brain Segmentation 


Magnetic resonance imaging (MRI) is a noninvasive method for producing three- 
dimensional (3D) tomographic images of the human body. MRI is most often 
used for the detection of tumors, lesions, and other abnormalities in soft tissues, 
such as the brain. Clinically, radiologists qualitatively analyze films produced by 
MRI scanners. 

Recently, computer-aided techniques for analyzing and visualizing magnetic 
resonance (MR) images have been investigated. Many researchers have focused on 
detecting and quantifying abnormalities in the brain. Automatically identifying 
the brain in MR images of the head is an important step in this process. Most 
often the radiologist is interested only the portion of the image which encloses 
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the brain. 


1.2.1 Multiple Sclerosis Lesion Segmentation 

Multiple sclerosis (MS) is an autoimmune disease characterized by damage of 
the myelin covering of neurons in cerebral white matter. The damaged areas or 
lesions are distinctly visible in MR images. For this reason, MRI is used to detect 
and track MS lesions in the brain. As MS progresses, the number and size of 
lesions in the sufferer’s brain increases. During treatment and clinical studies, 
doctors use MRI scans to monitor this change in lesion volume. The monitoring 
process involves painstakingly outlining every lesion in scans of possibly hundreds 
of patients. 

Therefore, researchers are investigating methods for automatically segment- 
ing MS lesions in MR scans of the head. One such popular method is Johnston’s 
segmentation method [7] which uses a stochastic, Bayesian relaxation based adgo- 
rithm called iterative conditional modes (ICM). Using tissue intensity histograms 
from manually identified regions in the MR scan, it attempts to isolate all tissues 
in the brain, including MS lesions, white matter, grey matter, and cerebral spinal 
fluid (CSF). Theoretically, it can also isolate tissues outside the brain, such as 
the eyes, skin, fat, and the skull. 

Because the distinct tissue types are represented by non-unique intensities in 
the MR scans, the ICM algorithm confuses tissues outside the brain with tissues 
inside the brain. For example, the intensity of the eyes could be identical to 
the intensity of some MS lesions. Further, the speed of the algorithm is propor- 
tional to the number of tissues it segments. It is therefore desirable to isolate 
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the brain in MR images before applying the ICM algorithm. This is another 
motivation behind the pre-processing of MR images in terms of automatic brain 
segmentation. 

1.2.2 Image Compression 

A. .single clinical .MR! scan occupies several megabytes of disk space. Effective 
image compression schemes are important for storing multitudes of scans. With 
the advent of teleradiology, where MRI scans are transmitted by wire to remote 
,site.s for evaluation by specialists, MR image compression plays a huge role in 
increasing transmission speed [8, 9]. Moreover, in MRI scans of the head, doctors 
are usually more interested in the brain as opposed to the region outside the brain. 
For this reason, one can develop a lossy MRI compression scheme that selectively 
compresses the region outside the brain at a higher compression ratio than the 
brain. Thus, one can achieve high compression ratios while maintaining image 
quality in the brain area. Obviously, automatic intracranial boundary detection 
is a prerequisite for such a scheme. 

This is the case \vith our teleradiology kit also. Since brain segmentation al- 
lows one to reduce the amount of data in the images slices, it results in significant 
savings in band'width, and can allow for the design of inexpensive telemedicine 
systems in our country. 

This thesis implements an automatic method for intracranial boundary detec- 
tion in MR images of the head at the server site. The intracranial boundary is the 
boundary between the brain and the intracranial cavity. It accurately segments 
the brain from other features in the head. 
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1.2.3 Available algorithms of brain segmentation 

The survey by Clarke et al. of segmentation methods for MR images [10] de- 
scribes many useful image processing techniques. Brain segmentation schemes 

-Ik 

can be divided into several groups; threshold based methods, refinement of brain 
contours, statistical methods and region growing methods. 


Brain extraction using automatic thresholding 

Su/.uki and Toriwaki use iterative thresholding to distinguish brain brain tissues 
from others m axial MR slices [11]. This method is ineffective in the presence of 
Radio Frequency (RF) inhomogeneity. 

Brummer at al. use histogram analysis and morphology to generate a 3-D 
brain mask [12]. Using a model of background noise, they first automatically 
generate a mask of the head. Then they create a brain mask using an automatic 
threshold based on a presupposed brain voxel intensity distribution. Mackiewich 
et al. [6] also adapted this technique. In our kit, we have modified this algorithm 
to suit the needs of a remote telemedicine application, so that the algorithm is 
fast and allows for data compression. 


Refinement of brain contour 

Chakraborty et al. combine statistical segmentation and boundary detection to 
isolate features in MR images [13]. They first segment the images using a method 
similar to the iterated conditional modes algorithm [7]. They then use a para- 
metrically deformable shape model algorithm to find the boundary of interesting 
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features in the segmented image. 


Luruiervold and Storvik proposed a segmentation for brain parenchyma in the 
central slices of multispectral MR images [14] which uses a model-based segmen- 
tation method and also uses a new Bayesian dynamic contour (BDC) model to 
detect the boundaries. 


Statistical Methods for brain segmentation 

Kapur et ai [15] combine Well’s statistical classification of MR images [16] with 
image processing methods, to segment the brain in 3-D gradient-echo MR images. 

Cline at al. segment the brain from MR images of the head using statistical 
classification [17 . To segment the brain, samples of brain voxels and non-brain 
voxels iire interactively i identified. Bivariate normal distributions, corresponding 
to the different tissue types in the PD- weighted and T2- weighted MR images, are 
fitted to the samples intensities. All the image voxels are then classified according 
to their intensities lie in the distributions. This method requires user interaction, 
and falsely classifies non-brain regions such as eyes, as brain. 


Region Growing and Boundary Detection 

Pannizzo et al. detect the intracranial boundary in axial MRI slices by tracing 
a horizontal line outwards from the center of the image [18]. The point, in each 
direction, at which the voxel intensity under the line drops below a reference 
threshold is considered to be a point in the intracranial boundary. A running 
average of voxel intensities under the brain is then computed. The intracranial 
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boundary points are relocated to the first voxels with an intensity too faur below 
the average. The running-average procedure is repeated for rows in the image. 
The entire process is then repeated for all columns. The result is a sequence of 
points defining the intracranial contour. 
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Chapter 2 


Remote Radiologist Interface 


2.1 Overview 

A simple Graphical User Interface (GUI) based client-server application has been 
developed in this thesis for the purpose of teleradiology. The client site is also 
the Doctor site where the GUI application is run. The server site is the patient 
site where the MRI scan acquisition takes place. The doctor connects to the 
patient site through the GUI application and requests for MRI slices. After 
intracranial boundary detection at the client end, the images are sent to the doctor 
(ser%'er) end, where the doctor can apply several post-processing algorithms (not 
implemented in this thesis). 
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2.2 Client-Server Model of Networking 


The late 1980’s had seen a major paradigm shift in the way people use computers. 
.A. new model of computing was born, known as client-server computing. In a 
client-server environment, one or more powerful, centralized machines, known 
as sen.'ers, provide a variety of services to individual workstations, or clients. 
For exmnple, file servers provide common storage for user files, and users access 
them through a number of different protocols. An anonymous ftp server in the 
internet typically stores lots of useful software packages to be downloaded by 
people around the world through several client softwares like ftp or netscape. 
Obviously, this model of computing became more and more popular ivith the 
proliferation of the internet. Application softwares in any conceivable field were 
being written as client-server applications, which not only ensured optimum usage 
of computing resources in a networked environment, but also allowed users to 
get access to information residing on a remote machine through a well-defined 
programming interface. The telemedicine applications are inherently network- 
btised applications, and are therefore always based on client-serv'er computing. 


2.3 Inter-Process Communication between Client 
and Server 


The communication between the client and the server is actually the communica- 
tion between two (or more) processes (programs) running on different machines. 
Therefore, the server is actually synonymous to the server process running on the 
server machine, and the client is synonymous to the client process running on the 
client machine. 
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Now. the server and the client programs must communicate with each other. 
In our case, the GUI-based application running at the doctor's site must commu- 
nicate with some server program at the patient site. 

Huw dot's this happen ? 

There are several kinds of programming facilities available for achieving the 
above, together known as the Inter-Process Communication (IPC) facilities [19, 
2()[. The basic idea of this programming interface is to make IPC similar to file 
Input/Output (I/O). In a UNIX system, a process has a set of I/O descnptors. 
from which one reads and to which one writes.' Descriptors may refer to normal 
files, to devices (including terminals), or to communication channels. This identi- 
fication of IPC with I/O is quite longstanding in the UNIX system and has proved 
(juite successful. At first, however. IPC was limited to processes communicating 
within a single machine. With 4.2 BSD (Berkeley Software Distribution) version 
of the UNIX operating system, however, this has been extended to include IPC 
between machines. 

The most common IPC facilities available in the UNIX system are signals, 
pipes, shared memory, semaphores, message queues and socket-based IPC [201. 
We have used socket-based IPC to implement the communication between the 
patient and doctor ends. 

‘ Note: \Ve shall limit our discussion to UNIX systems only since this is the operating system 
of choice in a networked environment. However, some of the IPC facilities are now also available 
in Microsoft-based operating systems. 
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2.4 Socket-Based IPC 


Sockets '21] provide a programming interface which maybe used for network com- 
munications. A socket is a communication endpoint and represents an abstract 
object that a process may use to send or receive messages. With socket-based IPC. 
one has a choice of mode of communication. Communication is either through 
a stream socket or by datagram. Stream communication implies a connection. 
The communication is reliable, error-free, aud no message boundaries are kept. 
Reading from a stream may result in reading the data sent from one or several 
calls to write C) or only part of the data from a single call, if their is not enough 
room for the entire message, or if not all the data from a large message has been 
transferred. The protocol implementing such a style will retransmit messages 
received with errors. Datagram communication does not use connections. Each 
message is addressed individually. If the address is correct, it will generally be 
received, although this is not guaranteed. 

A protocol is a set of rules, data formats, and conventions that regulate the 
trmisfer of data between participants in the communication. In general, there is 
one prorocol for each socket type (stream, datagram etc.). Since our application 
must transfer data reliably, we have used a streamed socket type. And we have 
used the Transmission Control Protocol (TCP) which is the default protocol for 
connection-oriented sockets. 
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2.5 General System Architecture 


In a connection oriented protocol, the server program first opens a communication 
endpoint (a socket) by calling socketO , then binds it to a port^ through bindO . 
It then calls listenO, in which it blocks until a client requests a connection. 
Meanwhile, a client program, usually on a different machine, calls socket!) and 
bxndO, followed by a connect!) to connect to the server. The client blocks in 
connect!) until the connection is established. 

When the connection request arrives at the server machine, listen!) returns, 
iind the server calls accept!) to accept the connection. This sends a reply to the 
client, which returns from connect!). The connection is now established. The 
server, in general, now sits in a loop, calling rev!) or read!) to receive a client 
request, processing it, and calling snd!) or write!) to send a reply. Similarly, 
the client calls snd!) or write !) to send a request and rev!) or read!) to receive 
a reply. This is depicted in Figure 2.1. 


2.6 Design of the GUI 


The application running at the client (doctor) site as part of our teleradiology kit 
provides a simple GUI for the doctor to operate. The GUI was developed with 
the following design objectives in mind: 

^The port number can be thought of as the number of a msulbox, into which the protocol 
places one’s messages. The system will assign an unused port number when an address is boimd 
!say by bind!)) to a socket 
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Figure 2.1: System Architecture for TCP socket-based BPC 
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1. Since it is a networked application, and patient data is confidential, ade- 
quate security measures should be implemented for authentication and data 
trjuisrnission. 

2. The GUI should provide logical functionalities required of a teleradiolog>' 
kit. like retrieving data for different patients, the ability to control the pre- 
processing at the server end etc. 

3. Provision for data caching should be provided, since transmission of image 
.slices containing huge amount of data is an expensive operation. 

4. The response of the interface should be as fast as possible. 

5. The GUT should be aesthetically pleasing. 

2.6.1 The choice of Tcl/Tk 

Tcl stands for Tool Command Language. It is a general purpose scripting lan- 
guage built as a C library’ package. Tk stands for Tool Kit, which is an XI 1 (The 
.X- Window System used in all UNIX systems) toolkit based on Tcl. Tcl and Tk 
together provide a programming system for developing and using graphical user 
interface (GUI) applications. 

GUI applications in telemedicine intended for use over the network have been 
generally written in JAVA [o], or C [4]. JAVA seems to be a very popular choice 
because of its platform independence and extensive libraries available for GUI 
development. However, JAVA applets running in a browser tend to be extremely 
slow because of in-built security checking as well as the fact that it is interpreted. 
Coding in C would always result in a robust and efficient application, but the 
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downside is the huge effort in%'olved in coding and debugging, particularly for 
Gl’I de%-elopment. 

In this respect. Tcl and Tk [22] provide some attractive features catering to 
our design objectives which prompted us to choose them as our development base. 

1. GL I applications can be written entirely as Tcl scripts, using a windowing 
slu'll calltHl wish. This allows one to program at a much higher level that 
one would in C, C++ or .}A\'A. .And Tk hides many of the details that C 
programmers must adders. 

2. Since Tcl is an interpreted language, it allows rapid application develop- 
ment. One can generate and execute new scripts on the fly without recom- 
piling or restarting the application. Since Tcl is interpreted, it executes 
more slowly than compiled C code. This is the case with JAVA. also. But 
since Tcl is embeddable, the performance-critical parts can always be imple- 
mented in C. 

.3. Tcl makes it easy for applications to have powerful scripting languages. To 
create a new application, all one needs to do is to implement a few new Tcl 
commands that provide the basic features of the application. Then one can 
link one's new commands with the Tcl library to produce a full-function 
scripting language that includes both the commands provided by Tcl and 
those that one wrote himself. 

Keeping in view the above advantages, we chose Tcl/Tk for the GUI develop- 
ment. As we discuss the GUI in the following sections, this will become clearer. 
And our teleradiology kit, which is therefore an extension of Tk, is called Bk 
(Brain Kit) (Figure 2.2). This is the client software. The server software which 
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Figure 2.2: The Teleradiology kit Bk. at startup 

runs at the patient site is called the Image Transfer Protocol Server (ITP server) 
since it implements a protocol for transferring brain images. 
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2.7 Working of the Teleradiology Kit, Bk 


In this section, we shall discuss the GUI in more detail and look into the various 
features that have been implemented. Bk has been implemented in two layers: 

• The graphical user interaction and display of images are handled entirely 
by Tcl scripts. 

• The network programming and image processing is done by code written in 
C. 

This two-layer design optimizes performance, because the computation intensive 
jobs and critical interaction with the server are always handled by Tcl procedures 
implemented in C. The C code is compiled as a statically linked shared library 
and is loaded into the Tcl interpreter at run-time when Bk is invoked. This has 
been possible because of the extensible nature of the Tcl language. 

Bk provides the following functionalities to the user (the doctor): 

1 . It provides a standard UNIX authentication scheme for the user. 

2. It supports the handling of MRI scans of multiple patients (upto a maximum 
of 5 in the current implementation). 

3. It allows the doctor to remotely issue commands for head and brain seg- 
mentation of the MRI scans. 

4. Based on the detected brain boundary or head boundary, it provides a 
simple image compression technique for the transfer of data slices over the 
network. This can also be turned off if so desired. 
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5. It provides dynamic selection of location as well as tyTje (original/head 
mask/brain mask) of slice to be displayed. 

6. It provides optional viewing with detected bounding boxes. 

7. It provides a simple data caching mechanism to minimi 2 e data transmission 
by keeping track of already transferred slices so that in case of a repeat 
request, a slice is not transferred again. 

.A.11 of the above will be discussed in greater detail in subsequent sections. 


2.8 Authentication 

Once the GUI application is started by the radiologist at the client machine, the 
first thing he/she needs to do is to is to make a connection to the ITP server 
program running on the server machine. For this, Bk needs to know two things: 
the name of the server machine, and the port no. at which the server is listening 
for client requests. A default server name is selected by the Tcl script at startup. 
It can. however, be changed by the Options menu item on the menu panel as 
shown in Figure 2.3. 


The port no. of the listening port is coded inside the Tcl script. Instead, it is 
possible to use the portmapper protocol [19] if the server has registered its service 
with the portmapper process. But this requires the server to run on privileged 
ports requiring superuser access. This could trigger a possible security hole in 
the system, and has been, therefore, avoided in the present implementation. 
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Figure 2.3: The option for changing the sercer 

Tile connection to the server is made by selecting the Connect to Image 
Server option in the Server option menu. The doctor has to fill in his user 
name and password in the dialog box that pops up (Figure 2.4). The user name 
and password strings are sent to the server which authenticates the doctor using 
the Data Encryption Standard Algorithm (DES) [28] used in UNIX systems for 
password authentication. If the authentication is successful, a connection is es- 
tablisheti with the server and the client asks for initialization, discussed in the 
next section. Otherwise, the connection is dropped and the socket is closed. 


2.9 Initialization Procedure 

Once the doctor is authenticated and a connection is established, Bk asks for 
initialization data from the ITP server. This basically consists of the names and 
total no. of patients whose MRI scans are available for examination. The server 
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Figure 2.4: Doctor's Authentication, (a) The Connect option in the Server 
menu, (b) Authentication window. 


finds out the required information and sends it back. Upon receipt of this data, 
Bk creates the Patient menu, which has so far been deacth’ated (Figure 2.2). 
The first patient in the queue is automatically selected for examination (Figure 
2.5). 


At this point, the doctor is ready to examine the scans of the patient selected. 


2.10 Remote Command Buttons 

The doctor can issue remote commands through the various buttons available on 
the right-hand panel of Bk (Figure 2.2). The same commands are also available 
through the pull down Server menu. These commands are described below: 
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Fiijiirp 2.5: Tlip Patient option menu activated once the patient list is obtained 
from the server. 

• Check Link : This button tests the ITP connection (if already established) 
to .see if the image transfer rates are satisfactory or not. A test image is 
triuisfertwi from the server and displayed (Figure 2.6). 


• MRI Slice : This button transfers and displays the original MRI slice ac- 
cording to current selections, i.e., the patient selected, the slice type selected 
(PD,T1 or T2) through the Options->Slice type menu item (Figure 2.7) 
and the slice no. selected IBrom the listbox with scrollbar on the left panel 
of Bk. If compression is turned on, compression according to head mask is 
performed. 
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Figure 2.7: The Slice type menu option to change the type of slice (PD/T1/T2) 
to be viewed. 
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• Head Mask This button transfers and displays the head mask overlaid on 
the origiiuil slice aocording to current selections. 

• Brain Mask This button transfers and displays the detected brain mask 
overlaid on the onginal slice according to current selections. 

• Other Server menu commands: There are two additional remote server 
eonuuands available on the Server menu for triggering segmentation com- 
ptitations by the server. The Do Head menu item (Figure 2.4) asks the 
server to earrv' out head mask detection computations. The Do it all 
menu item forces brain boundary detection for the whole MRI volume. 


2.11 View options 


There tire a couple of viewing options provided through the pull-down View menu 
(Figure 2.8). The bounding box of a mask is shown if a masked slice (head mask 
or brain imisk) is being displayed when the Bounding Box option is selected. 
Stmietim<*s it is useful for the radiologist to look at the edges of the image to 
make mi analysis. Therefore, an edge detection option is also provided in the 

View menu. 
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Figure 2.8: The View menu options. 

2.12 Post-processing Buttons 


On the right hand panel, three buttons corresponding to different post-processing 
algorithms are pronded. As earlier mentioned in Chapter 1. since these have not 
been implemented in this thesis, these buttons are kept deactivated. 


2.13 Image Compression 


A knowledge-based compression scheme has been implemented in the ITP server. 
Since one of the prime purposes of carrying out intracranial boundary detection 
at the server end is to be able to do region-based compression, we have done so, 
in a very simple way. 
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If the image slice with the brain mask overlaid on it is to be transmitted, the 
ITP server determines the brain bounding box from the mask, and codes all non- 
brain pixels at half the greyscale depth compared to their original depth (e.g., if 
the pixels were originally represented by 8 bits, now they will be represented by 
4 bits only). The brain region is transmitted at the original resolution. 

Similarly, if the image slice with the head mask overlaid on it is to be trans- 
mitted, the ITP server determines the head bounding box and it codes the pixels 
outside the box at half the original resolution. This is done even while serving a 
request for original image slice. 

This is a lossy compression scheme, but is capable of achieving high compres- 
sion ratio without compromising image quality at the important portions of the 
image. The knowledge that the doctor is usually interested only in the brain 
region is utilized in a simple manner to produce compression. The results of such 
compression is discussed in more detail in Chapter 4. 
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Chapter 3 


Brain Segmentation 


3.1 Overview 

An automatic method for segmenting the brain from head magnetic resonance 
(MR) images has been implemented on the server side of our teleradiology kit, 
Bk. This method uses an integrated approach which employs image processing 
techniques based on anisotropic filters, morphological operations, and a priori 
knowledge, which is used to remove the eyes and other non-brain regions. It is a 
multistage process, involving first removal of the background noise leaving a head 
mask, then finding a outline of the brain using the head mask information. 

Recall from Chapter 1 that the primary goal of intracranial boundary detec- 
tion in this thesis is to develop a preprocessing step that will allow for significant 
data compression for data transmission and improve the performance of MS le- 
sion segmentation algorithms, brain tumor detection algorithms and other kinds 
of post processing algorithms normally used by the radiologist. These algorithms 
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Figure 3.1: A simplified data flow diagram representing automatic intracranial 
boundary detection 

have difficulty dealing with tissues outside the brain, such as skin and fat. because 
these tissues can have similar intensities as brain tissues and MS lesions. Conse- 
quently, the removal of tissues outside the intracranial boundary is necessary for 
successful segmentation. 

We have implemented an automatic intracranial boundary detection method 
consisting of two main steps: 

• Segment Head 

• Generate Brain Mask using Head Mask information 
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The method assumes that PD- weighted and a T2- weighted MRI data sets have 
been simultaneously acquired.The steps are explained in detail in the following 
sections 


3.2 Segment Head 

The Segment Head process uses histogram analysis to automatically threshold 
data from background noise in MR images. 

3.2.1 Histogram Image Volume 

The PD-weighted MR image volume, which resides in a directory in the form 
of individual files representing individual slices is read in and a voxel intensity 
histogram is produced. Along with this, the standard deviation and mean of each 
iiitensiiy level is also calculated for the whole MR volume. 


3.2.2 Determine Background Threshold Level 

This step uses the method suggested by Drummer et al. to determine the “best” 
threshold level for removing background noise in PD-weighted MR images [12]. 
The background noise in PD-weighted MR scans has a Rayleigh distribution. The 
method fits a Rayleigh curve to the low intensity bins in the histogram using a 
Levenberg-Marquardt minimization algorithm [23]. The threshold is then chosen 
using error minimization. The subtraction of the best fit Rayleigh curve function, 
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Figure 3.2: The best fit Rayleigh curve superimposed on the histogram of Data 
Set 2. In this case, r = 20. Note that the whole range of intensity levels (256) is 
not shown. 

r(/), from the volume histogram, h{f), produces a bimodal distribution: 

9{f) = Kf) - ^(/) (3.1) 

A minimum error threshold, r, can be determined from g{f) by minimizing an 
error term, Cr'- 

er = £?(/) + !]’•(/) (3-2) 

/=0 /=T 

Figure 3.2 shows the Rayleigh curve superimposed on the histogram of Data 
Set 2. 
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(a) (b) 


Fiu;ur(' 3.3: An initial head mask produced using an automatic threshold, (a) 
Original image. ;b} Initial head mask. 

3.2.3 Binary Thresholding 

Xow. we threshold the grey-valued MR volume at r, producing a binary* image 
volume. The result of this threshold is showm in Figure 3.3 for slice 29 of Data 
Set 2. .Notice that the binary’ image contains “speckle'’ outside the head region 
and that there are misclassified regions within the head. This ■’noise” is removed 
using morphological operations. 


e. 
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(il) (b) 


Filin' 3.4: Refining the head mask of Figure 3.3(b). (a) After Pepper-and-Salt 
.\’oi.se Removal. ;b) Final Head Mask after row-scan algorithm. 

3.2.4 Remove Noise 

The sequence of morphological operations performed on the thresholded image is 
described below: 

Pepper-and-Salt Noise Removal 

Single-pixel objects in a background and single-pixel holes in an object of a binary 
image, referred to as pepper-and-salt noise, are often the result of propagation of 
uncorrelated noise in an original image through some binarization process. They 
can be detected as pixels with binary value different from all neighbors, and they 
can be removed by changing their binary value. 

We extend this concept to two-pixel wide speckle by removing isolated two- 
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pixel wide objects in a background and holes in an object of a binary image. The 
result of this operation is shown in Figure 3.4(a). 


Get the Head Mask 

The next stage involves the detection of the head boundary. Operations like 
region filling, followed by binary erosion and subsequent binary dilation have 
been suggested by Atkins at al. [6]. However, these are expensive operations and 
since our algorithm should work in a networked environment, one of the goals 
has been to reduce computational complexity. Therefore, we use a simple row- 
scanning and filling algorithm to identify the head mask. Each row is scanned 
once. During the scan, the initial run of white pixels is filled by black pixels if the 
length of the run is less than 4. The next run of white is presumed to be the head 
mask and the algorithm goes on filling pixels until it encounters the last white 
pixel in the row. except that, as in the beginning of scan, a stray run of white 
less than 4 at the end of the row is filled with black pixels. The head boundary 
detected by this method is not accurate for some slices, but this doesn’t matter 
much since we are going to use only the head mask bounding box information in 
later stages to identify the brain boundary'. The result of this operation is shown 
in Figure 3.4(b). 


3.3 Generate Brain Mask 


To isolate the brain from the other head components, such as the eyes, skin, 
and fat, we need to highlight the brain tissue and then use a threshold to re- 
move unwanted components. The Generate Brain Mask process uses a nonlinear 
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anisotropic diffusion filter to reduce the voxel intensities of tissues outside the 
brain. It then automatically thresholds the diffused volume and uses spatial 
information provided by the head mask to produce a mask of the brain. T2- 
weightcti MR images are used since they exhibit good contrast between brain 
and non-brain tissues. 

3.3.1 Nonlinear Diffusion Filtering 

This is the first step in the “Segment Brain’ stage. This step diffuses each slice 
of the image volume. The parameters of the filter were chosen such that pixel 
intensities in regions corresponding to brain tissue would be regularized while 
pixel intensities in other regions would be attenuated. The attenuation of non- 
brain voxels enables a single threshold to isolate the brain, even in the presence of 
RF inhomogeneity. The theory of diffusion filtering is briefly described in Section 
3.4. 

3.3.2 Automatic Threshold 


This step automatically determines a threshold level for segmenting brain tissues 
from the diffused MR volume. It does so by fitting a gaussian function to the 
histogram of the volume, then choosing a threshold level at a specified number 
of standard deviations from the mean. 

This method of automatic threshold detection was suggested by Brummer et 
al. [12]. They use the technique to segment the brain from non-brain tissues 
in unfiltered MR scans. They show that voxels inside the brain have normally 
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Figure 3.5: A histogram of the diffused T2-weighted MR scan with the best-fit 
Gaussian curve and threshold levels overlaid 

distributed intensities, / , with standard deviation cr: 

= 7^^ {-&) 

However, they have further shown that this is true only in case of PD-weighted 
MR scans. Brain voxel intensities in T2-weigiited MR scans represent a somewhat 
normal, but skew intensity distribution. However, the regularization achieved by 
diffusion filtering results in a distribution that is close to normal. Figure 3.5 
shows the voxel intensity histogram of the diffused Data Set 1 volume with the 
best fit gaussian curve overlaid. The threshold level is superimposed, which is 
taken 2 standard deviations below the mean for all cases. Using this threshold, 
each slice of the diffused MR volume is now binarized to produce a crude head 
mask. Figure 3.6 illustrates the results for slice 6 of Data Set 1. 
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(a) (b) 


Fifpirp ;}.(): A binary mask produced by automatic thresholding, (a) The diffused 
irruiRt* .slice, (b) The corresponding binary mask. 


3.3.3 Eliminate Misciassified and Non-Brain Regions 

The binary mask includes non-brain regions, such as the eyes, and misciassified 
regions within the brain. These errors can be eliminated using morphology and 
spatial information. Non-brain regions are removed from the initial binary brain 
mask using a sequence of morphological operations described below: 
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Region filling 


First, holes within each region in the binary mask are filled using a simple 10x10 
square structuring element. 


Erosion 

Next, binary erosion is performed to separate the weakly connected regions. The 
mask used for erosion is a 10x10 structuring element with six off-pixels symmet- 
rically placed at each of the four comers resulting in a hexagonal mask as shown 
below: 
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Edge Detection and Thinning 


Next, in tlie t?rodod image, the edge of eadi region is detected by using standard 
image gr.uiient operation. The edges produced by this may be “thick'’ . Therefore, 
thinning of etiges are done so that edges of all the regions are one pixel thick. 


Expert Elimination of Non-brain Regions 

Once we have the thinned edges of all the regions, we detect each region by tracing 
Its contour. Thus, we have the contours of all the regions. Next we remove non- 
brain regions using expert knowledge and spatial information from the head mask. 
We <io so by eliminating features whose centroids fall outside the specified region 
within the head. Figure 3.7 illustrates the procedure. Rather than using a single 
brain bounding box for this purpose we use three different bounding boxes (with 
three different sets of parameters minX, max X,rninY, maxi: ) for three sets of 
slices in an MR volume. This is found to improve the performance in slices in 
which the brain tissue occupies a very small region. The value of parameters used 
were selected experimentally to produce consistent results for all slices of all data 
sets presented in this thesis. 


Dilation 


Once we have identified the region(s) corresponding to brain tissue, binary di- 
lation of contours are performed with the same structuring element as used for 
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Figure 3.7: Spatial information from the head mask is used to eliminate re- 
gions that axe unlikely to correspond to brain tissue. Closed contours whose 
centroids fall outside the brain region bounding box are discarded. In this case, 
minX=0.3,maxX=0.75,minY=0.75,maxY=0.6. These values are taken to be dif- 
ferent for different set of slices depending on its location. 
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erosion shown earlier in this section to restore some of the peripheral tissues black- 
ened by erosion. Now, the regions appear as thick rings whose outer boundaries 
are the ones vihich actually represent the intracranial boundary. 


Get Brain Contour 

Fiiuilly, wlge detection and thinning are once again performed on the rings (re- 
gions) and the outer boundary of each ring thus detected represents the boundary 
of some brain tissue region in the MRI slice. 

The whole process of expert elimination of non-brain regions from the brain 
mask using morphology and spatial information is shown in Figure 3.8 for slice 
10 of Data Set 1. 


3.4 Theory of Diffusion Filtering 

Nonlinear anisotropic diffusion filters are iterative, tunable filters introduced by 
Perona and Malik [25]. Gerig et al. used such filters to enhance MR images [26]. 
Sapiro and Tannenbaum used a similar technique to perform edge preserving 
smoothing of MR images [27]. In the extreme case, such smoothing might produce 
a profile of RF inhomogeneity in the images. Others have shown that diffusion 
filters can be used to enhance and detect object edges within images [25]. 

Since these filters smooth or enhance MR images and detect edges, they might 
also be used for RF correction and/or intracranial boundary detection in MR 
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(g) (h) (i) 


Figure 3.8: Morphology and spatial operations to segment brain, (a) Thresholded 
T2 image slice, (b) Regions filled, (c) After binary erosion, (d) After edge 
detection of all regions, (e) After edge thinning, (f) After expert elimination 
of non-brain regions, (g) After binary dilation, (h) After edge detection and 
thinning of dilated image, (i) Final brain boundary detected overlaid on the PD 
scan of the same slice. 
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uiuiKCS. To this t’lul, nonlinear anisotropic diffusion filters axe studied here. 


3.4.1 Definition 

Perona and .\talik formulate the anisotropic diffusion filter as a diffusion process 
that encourages intra-retpon smoothing while inhibiting inter-region smoothing. 
Mathenjatically. the process is defined as follows: 


4(x.0 = V*(c(xJ)V/(x.t)) (3.4) 

ut 

In our case. I{x\t) is the MR image, x refers to the image axes (i.e.x;y;x) and 
* refers to the iteration step. c(x; t) is called the diffusion function and is a 
monotonically decreasing function of the image gradient magnitude: 

c(x,t)=/(lVJ(x,t)|) (3.5) 


It allows for loctdly adaptive diffusion strengths; edges are selectively smoothed or 
enhant'ed based on the e\-aluation of the diffusion function. We use the following 
diffusion function sugg^ted in [25]: 


c(x,«) = exp 




(3.6) 


K is referred to as the diffusion constant or the flow constant. Obviously, the 
behavior of the filter depends on k. To clarify the effect of k, and the diffusion 
function, on the diffusion process, it is helpful to define a flow function: 


#(x,t) =c(x,i) • VI(x,i) 


(3.7) 


Equation 3.4 can be rewritten as: 

i/(i,t)=V.(*(J,4)) (3-8) 

at 
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Fii^tire 3.9: Flow function plotted as a function of image gradient 

The flow function corresponding to the diffusion function in Equation 3.6 is 
plotted in Figure 3.9. 


Notice that flow increases with the gradient strength to the point where 1 VI [~ 
/c, then decreases to zero. This behavior implies that the diffusion process main- 
tains homogeneous regions (where | VJ |<C k . ) since little flow is generated. Sim- 
ilarly, edges axe preserved because the flow is small in regions where | V/ ]> /c. 

The greatest flow is produced when the image gradient magnitude is close to 
the value of k . Therefore, by choosing k to correspond to gradient magnitudes 
produced by noise, the diffusion process can be used to reduce noise in images. 
Assuming an image contains no discontinuities, object edges can be enhanced by 
choosing a value of k slightly less than the gradient magnitude of the edges. 
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3.4.2 Discrete Implementation 


Th(’ (Jiscn’to inipUnufHtation of the nonlinear anisotropic diffusion filter is straight- 
forward. tht* tietiiils of which are given in ’24]. Here we shall write down the 
expr«*.sMun for the 2-D discrete implementation which we have used for filtering: 




(3.9) 


d_ 

dy 

1 




Ax 


(Ax)'-* 
-c ^x 
1 


c f X 4- — ,y, ij ■ y> y> 0) 


Ax 


(AyF 

-c fx 


(/(x. y,t)-T(x- Ax. y, t)) 
Ay 


c f X, y 4- -y. y. i j • (/(a:, y 4- Ay, t) - J(x. y, t)) 


•{I{x.y,t)-r{x,y- Ay,t)) 

^eaat 4" ^west + ^north + ^south lA®=:Ay=l 


The filtering process consists of updating each pixel in the image by an amount 
e<puil to the flow contributed by its four nearest neighbors: 

/(x. y,t'^ Af) w /(x, y,t) 4- At • ($«a»t — + ^nor^ + ^south) (3.10) 


where At, the iteration step size, is a filter parameter. 
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Chapter 4 


Results and Discussion 


4. 1 Overview 

In this chapter we shall present the results of applying our automatic intracranial 
bouiitlary detection algorithm to the available data sets. We shall also illustrate 
a typical se.Hsioii with our teleradioiogy kit Bk and investigate its performance. 


4.2 Data sets 

Data set acquisition has been a major problem right from the beginning of our 
work. First, the Visual Human Data [2] were acquired but were later on found 
to be unsuitable. Then, v?e could finally acquire 2 data sets from the Simon 
Fraser University, Burnaby, Canada. Data Set 1 has 22 slices, vnth both PD and 
T2-weighted scans available. Data Set 3 has 20 slices, also with both PD and 
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id) (e) (f) 


Fijfiin* 4.1: Slices from MRJ DataSet 1. (Top) PD-weighted. (Bottom) 

T2-wt*ighieti. (aKidlSlice i. (b),(e)Slice 8. (c),(f) Slice 15. 

T'i-weighied setms available. Data Set 2 is the Visible Human Data in which 33 
siice.s of all the PD.Tl and T2-weighted scans axe available. But this was not 
used for brain segmentation. Some results of head segmentation on this Data Set 
axe shown in Chapter 3. 
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Figure 4.2: Selected Slices from MRI Data Set 2. (Top) PD-weighted. (Mid- 
dle) T2-weighted. (Bottom) Tl-weighted. (a)j(d),(g)Slice 1. (b),(e)j(h) Slice 8. 
{c),(f),(i)Slice 15. 
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(e) 


(f) 


Fi>^re 4.3: Selected Slices from MRI Data Set 3. (Top) PD-weighted. (Bottom) 
T2-weighted. (ai.(d)SIice 4. (b),(e)Slice 9. (c),(f) Slice 19. 
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4.3 Results of Head Segmentation 


In orti.'r tt) th'tpct the intracranial boundary', the first step is to identify a head 
mask from the PD- weighted MR volume. The sequence of steps for doing so have 
been detailed in Section 3.2. Results of head mask detection for two data sets 
are shown in Figures 4.4 and 4.5. 


Note that the head boundary detected in some cases appear to be a discon- 
tinuous contour. This is so because the boundary points are identified in a single 
scan through the image to reduce computational complexity. Since each row is 
scanner! exactly once, there are two boundary points in each row, because of 
which, kinks jure not traced properly. However, this doesn’t defeat the purpose of 
hear! rmisk rletection. .since all we want from the head mask is the head bounding 
box which is used as a priori knowledge for brain contour detection. The head 
mask will still, almost always, be the same even if the head boundary detected 
is discontinuous. In fact, in doing so, we don't lose any information as explained 
above, rather gain in terms of faster computation, which is crucial in a networked 
environment. 
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Figure 4.4; The Head Mask as well as the Head Bounding Box for MRI Data Set 
I overlaid on the PD-weighted scan 


:r^rsuso45 
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Figure 4.5: The Head Mask as well as the Head Bounding Box for MRI Data Set 
3 overlaid on the PD-weighted scan 
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4.4 Results of Intracranial Boundary Detection 


Oncf hiivi- tin* hfiul nuusk information for each slice in an MR volume, we 
apply UDii-liiuMr amsoiropic diffusion filtering on the T2-weighted volume (See 
StH'titm 3. \). The filter parameters used in all the cases are: k = 128.0 and 

=s 0. 19. 20 Iterations of filtering were carried out in each case. These numbers 
were idl expenmenudly tieiermimnl to give best results with all the data available. 

.■\fter this, the filtered data is binarized by automatic thresholding and a 
.setjuence of morphological operations are applied to the resulting binary image 
to e.xtracl the brain contour. These methods have been discussed in detail in 
Section 3.3. Here we present results of brain boundary detection for Data Sets 1 
juid 3. ^ Figures 1.6. -1.7. 4.8 and 4.9). 


4.5 Discussion on Brain Segmentation 

As we can see from the figures, the boundary detection algorithm performs very 
well in almost all the slices. The few cases of misclassification are. In slice 22 
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Figure 4.6: The Braia Mask for MRI Data Set 1 overlaid on the PD-weighted 
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scan: Slices 1-11- 


Figure 4.7: The Brain Mask for MRI Data Set 1 overlaid on the PD-weighted 
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scan: Slices 12-22. 




scan: Slices 1-10. 



Figure 4.9: The Brain Mask for MRI Data Set 3 overlaid on the PD-weighted 
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scan: Slices 11-20. 




Figure 4.10: Authentication dialogue box at startup 
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Fiii;uro S.ll; The S©rver->Do Head command has been invoked after selecting 
.'.lire 17 from the listbox and Patientl from the Patients menu. 



Figure 4.12: After Head Mask detection, the 17th slice for Patientl has been 
transferred and displayed on the display area. 
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Fiiyiin' 1. 13: The doctor has selected the View->Bounding Box option so that the 
head bounding box is being displayed. 

4.7 Discussion on Teleradiology Kit 


Tl»» ku wjuj tesiwl on the Local Area Network(LAN) in the IIT campus, and the 
test sessions ran without any problem over our ethemet-based TCP/IP network. 

In Figure 4. 16. the 7th slice of Data Set 1 with detected brain contour overlaid 
is displayeti on Bk after transmission without knowledge-based compression. In 
Figure 4.14, the compression scheme suggested in Section 2.13 is employed. The 
amount of data compression thus achieved is 41.83%. This is a huge compression, 
whereas there is no appreciable difference in image quality in the two figures. In 
fact, since the non-brain portion is seldom important for radiologist, one can go 
for very high compression ratios based on the bounding-box region-based com- 
pression. This is what has been done in Figure 4.15, where the region outside the 
brain bounding box has been coded by only 2 bits. In this case, the compression 
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Fwirt* III. After selecting the 7th slice from the listbox, Brain Mask button has 

been prei;se<i. The command for doing head contour detection is automatically 
issued to the ser%-er and the selected slice -with brain mask overlaid is transferred 

and displayed. 
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Fiijtirt* 1,15: Tlu* 7th .slice with brain mask overlaid, same as Figure 4.14, but 
with a very high compression ratio. 



Figure 4.16: The 7th slice with brain mask overlaid, same as Figure 4.14, but 
with comprffision turned off from the Options->Compression off menu option. 
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ih ;us h5ii»h as 62.74%. The amount of compression will of course, vary, as 
tlu’ hr.un hounding box changes in size from one slice to another. 


4.8 Scope for Future Work 


There .ixe mimermis things that could not be done in this thesis and could be 
valuable atiditions to Bk. both in terms of better GUI and serv'er design and the 
brain >eginentation algorithm improvement. Some suggestions are given below: 

1. rhe post-proci'ssing algorithms for which buttons have been designed but 
kept de;u:tivated may be developed and incorporated. 

2. .\ report generation utility along with printing option for the radiologist 
etin be incorporated. 

3. 3-D visualization of MRI volume could be implemented using the popular 
extension of Tk called Vtk (Visual Toolkit). 

t. Bk .should be tested on Wide .\rea Networks (WAN) and on the internet. 

5. The algorithm for brain segmentation should be made more robust so that 
the rate of misclassification is reduced. Also, it should work properly with 
high resolution scans. 

6. The algorithm should be tested with more data and the results should be 
validated by a human radiologist. 
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